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This Memo de-scribes PROGRAMME, a parser for natural language. 
It oonaiata of & language for writing grammar* tn the form of 
programs i, and an interpreter which can. use these grammars to 
parse aentencee. PROGRAMMAR Is one part of an Integrate System 
being written for the computer comprehension Of natural language. 
Tbs system will carry on a fiiseourse in English, accepting data 
at at ement s , answering questions, and carrying out commands, It 
baa a vertically integrated structure, to perform parsing, semantic 
analysis, and deduction concurrently, and to use the results of 
eacb to guide the course of ttle entire process. This interaction 
ia poaaible because all three aspects are written in the form of 
programa. Tbia will allow the system to mate full use of its 
"intelligence" [including non-llnguistie Jcnowieo'ge about the 
subject being discuss-ed) in interpreting the meaning of sentences d 
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I, i 5YSTIH FOit QTID2IRSTAHDIJS3- HATOHAL LAH&CTAflB 

This paper desribes FBOGEAMMM* a language for the writing of grammars* 
PKOGftAMMAR was designed as an integral pare of a system for the computer 
understanding of English* The system answers questions* executes commands, and. 
accepts information la normal English sente neea. It uaes semantic Information ' 
and contact to Understand pronoun references la discourse and to disambiguate 
sents-ncea both grammatically and semantically* To do this It uaea a apeclal 
type of representation for both the grammar and the semantics. By representing 
these is the form of programs, it U possible to mafce full use of semantic and 
contextual information in deyeloping ao anal/sis of the sentence* It combines a 
complete grammatical analysis of the sentence with a "heuristic under stander" 
which uses all of ita information about ihe sentence* the discourse, and the 
world in finding the meaning of a sentence* 

The purpose of building this era tern was not to develop an applied system, 
but to explore the problems of grammar, semantics, and logic which must be 
sot?ed for the effective understanding of language. 

The project consists Of 6 interrelated carts, Of which PR0GEAHMA3 is the 
first. Roughly they can he described as follows: 

1] A system for the grammatical analysis of input sentences* There have been 

many different par sine systems deieloped hy different language projects, 

each T»se£ on a particular theory of grammar. The type of grammar chosen 
plays a decisive role in the tyre of semantic analysis which can be carried 

out, and ProGrahKaA was designed specifically to fit the type of analysis 

used in this system* It differs from other grammars in that the grammar 
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itself Is written in the form of a program, and tie parsing systes is in 
effect an interpreter for the language uasd in writ I as those programs, 

2) a gramar of English to te used by the systsa. I have written a fairly 
coaprehensiva grammar of English as a first approximation, follow Ida the 
lines of systemic grammar {see Section II, 4). Thejre Is one basic criterion 
for the completeness of the grammar, A person with, no knowledge of the 
system or its grammar should he alkie to type any reasonable sentence within 
the limitations, of the system's vocabulary and expect it to "be understood. 

3] A semantic system for extracting the meaning of the sentence from its 
gr&qtoat leal form, this again is a combination of a systea and a language* 
There are mechanisms for setting up staple types of seiantic networks and 
using deductions from them as a first phase of semantic anaysls. Mora 
important, the meaning of a word or construction is also defined in the 
form of a program to "be interpreted in a semantic language « It is this 
aspect of semantics 
which is missing io most other theories, which limit themselves to a 
particular type of network or relational structure. Part of this must 
include a powerful heuristic progran for resolving ambiguities and 
determining the meaning of references in discourse. In almost avery 
sentence* reference is made either explicitly (as with pronouns) or 
implicitly (as with the word "too"} to objects and concepts not explicitly 
mentioned in that sentence. To interpret these, the program must hare at 
Its disposal not only a detailed grammatical analysis (to check for such 
things as parallel constructions}, hut also a powerful deduct ire capacity. 



-a::1 a c -33 rough knowledge of 'he s'^jEn: it Id discus air.*. 
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4] A deductive system which can be used by the semantic system in carrying out 
the deductions which ate necessary not only for such thing* as resolving 
ambiguities and answering questions, but also for the directing of the 
parser * I plan to use FLAHSEfl, a deductive system designed by Carl Hewitt 
(A* I* Memo ia&J which It tased on a philosophy veey similar to the general 
mod of this project. Deduction is not carried out by a general procedure 
acting on a set of ailo*s or theorems expressed In a formal system of 
logic. Instead, each theorem i 3 i 4 the form of a program, and tat 
depictive process can be directed by intelligent theorems. PLAMEft is 
actually a language f &r the writing of those theorems. 

SJ A generative language capacity to produce answers to questions and to ask 
questions when necessary to resolve ambiguities, Grammatically this is 
much less demanding than toe interpretive canity, since humans can be 
expected to understand a wide range of responses, and it is possible to 
etpress almost anything in a grammatically simple way. However, it taies a 
sophisticated semantic a ad deductive capability to parage things in a way 
which is meaningful and natural in discourse, 

6] A base of semantic knowledge. This must include not onlr "dictionary 
definitions", but also an understanding of the subject being discussed. 
This will enable the system to make the deductions needed to uvder stand, 
what is being said. This will include both statements in the "semantics" 
language (equivalent to the traditional dictionary) and detailed PLAUKRE 
statements which i&chtde the practical knowledge <jf the world* I would 
lite to experiment with more than one field of discourse, but the emphasis 
will be on depth of understanding ratha r than breadth, rt will not try to 
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deal with, the entire contents of a children a' encyclopedia, or to treat 
objects as fornal items and accept statements an all subjects whatsoever, 
Tlie system, will be able to answer deep questions on a particular subject. 
For eiample, we might consider a robot with an eye, an arm, and tbe ability 
to pmtmilate slmpLe objects, We vonld lite to be able to say, '\ny did 
you pick up the green block while you were building the tower in the 
corner?", or "How sany blocks were behind the green one when it was the 
bottom of a three block a tact?" (note the use of "Vne", "it", etc*) and 
to- actually enter into discourse with a sequence of Questions, like "Is 
there a sphere on the table?** "tfbat OOlor Is- it?" "'rfhen was it pu: 
there?" "Were there any towers then?" 1 , etc, this will require giving the 
system a detailed model not only of the properties of blocks* hands, 
tables, etc*, but a model of its own mentality as well* It should be able 
to discuss its plans and thoughts, as well as use them, 

Listing these six aspects of language understanding separately is somewhat 
misleading, as it is the interconnection and interplay between the™ which makes 
the systea possible. The parser does not parse a sentence, then hand it off to 
an interpreter. As it finds each component it checks its semantic 
intepretatlou,. firat to see if it is plausibly then if possible to see if It Is 
in accord witb, the eyetea's knowledge of the world, both specific and general. 
This has been done in a Limited way by other systems, but I plan to use it as an 
integral part of understanding at every level* The features of PRO&RAMHJiR ate 
important not only in its effectiveness as a parser, but in the way they lend 
themselves to use as part of this complete language process* 

5 
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II » A Description of PH3&RAHMAH 



II .1 Introduct ion 

PfllOGflAMMAFt differs from other computer systems for natural language la 
three major ways. 

First, it ts based cm a different type of grammar i systemic gramaar, 
developed by M*A«K. Hal li day and Others at the University of London (see 
references 2S5] * This Is discussed further in Section Ll\4. The important 
thine about it is sot its specific fori or details, bat the fact that its 
general bias Is towards seeing Laasua^e a& a system for conveying meaning, not 
as strings of symbols. It of course does Manipulate the symbols of language, 
but in its analysis it makes heavy use of the very special ways In which 
Language systeaatlcally organises and conveys meaning* This emphasis mokes it 
much mora suitable for inclusion in a total unders sanding system than a more 
strictly formal theory, such a transformational srammar or any of the 
variations of contest-free grammars. 

Second t FRD&RAHMAR views a grammar as a program, and places great emphasis 
on the process pf understanding a sentence, rather than the form Of the abstract 
s true tn pea underlying it. This distinction does not give an abstract 
theoretical advantage since any type grammar has the same power, What It does 
allow is the organization of knowledge about language Into a very concise, 
usable , and efficient lorn. Most current grammatical theories are expressed in 
the form of a process, usually/ a generation process which acts on a set of 
syntas rules , each of which represents a simple process of replacement* By 
allowing the grammar to be expressed explicitly in the fori of a program, we can 
J eipres-3 regularities and facts, about language which would take very complex \ ( p 
additions to more rule-oriented forma of grammar + It also makes it possible 
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to intermix ids grammatical and semantic programs l*i a more intimate *ay # 
allowing them to work together at each point of the process of understanding. 

Of course this process is not intended as a direct model of a process used 
by nu nans any mors than the generation roles of other theories are believed to 
be actually carried out hy a language user. The fact that a program can he the 
best way to- structure and convey knowledge <io*s not imply that the program bag a 
psycho logical reality* It does, however safest that this type of 
representation may be highly useful and revealing in describing human behavior- 
■ Third, PfiOGRAMHAR sees language as a process of Intepretatlon* a gramnar 
Is a program for Interpreting sentences, rather than generating them* This 
approach hat has a nuaber of Important consequences to the satire process of 
linguistic understanding . This is discussed at length in another paper 
{reference G) t and win not o» described in detail here. We uill note that It 
aakee the Integration of the different levels of graaatar« semantics and 
deduction much simpler fcy giving U5 a coherent way to decide at which of these 
levels each type of linguistic fact is test handled* Many of the pr&aleBS in 
current linguistic theories result from trying to explain semantic facts at the 
syntactic level. !y putting syntax into an integrated system* and by allowing 
semantics to play a real part in sentence interpretation, many facts about 
language "bacons much more tractable . 
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11*2 Graaaar and Computers 

In order tD explain the features of PBDGflAMMAR, we will summarise soit of 
the principle* of grau&ar used ill enflsputer language processing. The basic form 
of most grafltpars 1* a list ( orders 4 or unordered) of "replacement rulas," which 
represent a procesas of sentence generation^ Each rule states that a t.»rtaljj 
string of symbols {its i#ft side) can be replaced by a differsnt tet of ajrahols 
(Us right sideK These ajBbols include both the actual syabols of the 
language (called terminal symbols]! and additional non-terminal symbols. One 
non-terminal symbol is designated at a star ting symbol, and a string of 
terminal symbols is a sentence if and only If It can be derived from the 
atartlag syabnl through successive application of tha rules. For aiaaiple we can 

write Grammar It 



1,1 S -* KP YP 

ta IP -> OBTEAHl^Bii HO 1ft 

1,3 YP -* TEWlSMiHSITIVI 

1,1 TF -> TEfifl/THAHSITI/E MP 

1,5 OETEfiKISEEl -> the 

L.6 NOUN -* Sifaffe 

1,7 SD&H -> apple 

1,3 TEflfi/IKTRAHSITITE -> dreaas 

1*9 FESB/TmSITIVE ~> eats 



Br starting with S and applying the list of rules {1.1 1.2 1,5 1,6 1.4 1,2 
1*7 1*5 1.9], we get the aenteac; "The giraffe sats ths apple." Several tbiu$& 
are noteworthy here* This is a a unordered set of miss, Each rule can be 
applied any numosr of tia*s at an/ point in the derivation where the symbol 
appears. In addition, each mU is nptioaal. We eouli jutt as well have 
reversed the applications of 1.5 and 1.7 to get "The apple eats the giraffe/' * 
or h&™ ns&a 1.3 and l.S to get "The gt faffs dreaas." This tyj» of derivation 
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can be M.pr»s»ntft4 iyapnically ast 
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the 



rratM 



apple 



tfe tfl LI call this the pars Lag tr*s for tii* apntence. and us* the usual 
terminology for trees [node, sUMreee, laughter, parent, etc,)* la addition ws 
will use the linguistic terms "phrase" anl "constituent" interchangeably to 
ra-fer to a subtree. This tree represents th* "immediate constituent" structure 
of the sentence. 
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II .3 Context-free ani C-ontext-aaasltive Grammars 

Grammar 1 U an example of what is called a context-free grammar. The left 

side of each rule Go-Mists Of a single symbol, anl the Indicated replacement can 

oocur wbene«r ttat symbol is encountered. There are a great number of 

differs tit foras of grammar yhicti can be shown to be eq, ultra Lent to this one, in 

that :lisy can characterize the same languages. It has been pointed out that 

they are not theoretically capable of expressing the rules of Ingllsh, to 

produce such teatances as. "John, Sidney, and Chan oi-dared an eggroll, a ham 

sandwich, and a bagel respect iFely," Much more important, even though they could 

theoretically handle the bulk of the English language, they cannot do this at 

ail efficiently. Consider the simple problem Of sn&jec-t-^erb agreement* ¥e 

would like a grammar which generates "The giraffe dreams, 1 ' and **Th* giraffes 

dreaa/", but not "The giraffe dream, ™ or "The giraffes dreams*". In a 

contest-free grammar, we can do this by introducing two starting symbols. S/PL 
and S/S& for plural and Singular re spec ti rely, tneit duplicating each nil* to 

match! Tor example .we would have; 



1,1.1 S/PL -> SG/PL TP/PL 

1,1. z s/sa -* bj/sg tp/sg 

1,2,1 SC/PL -> OETE^IKER NO OH/PL 

t*a.2 JK/SJ -» DETERHim HOUH/SG 



1.6.1 fflUH/PL ~> giraffes 

1.6.2 HDUH/SG -> glj-affe 

etc. 



; 
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If we then wish to handle the difference eeWeen "I aVp "ha Is", ate, we 
mist Introduce an eat ire new set of symbols for first-person* this sort of 
duplication propagate a aulllpliQ&Uvely through the grammar, and. arises In fill 
sorU of casas, For example h a question and the corresponding statement tf ill 
iiflrVe such in common concerning their subjects, objects verbs, etc., hut in a 
context-free grammar, they will in general be expanded through two entirely ' 
different seta of symbols. 

One way to avoid this Prcblea it to us* cc-ntext-sensltTe rules. In these, 
the Left side say include several symbols, and the replacement occurs when that 
combination of symbols occurs in the string being generated. 
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) 

11*4 Systemic trammar 

We can add power to our grammar with co nts.tt- sees it ve rules which, far 
example* In expanding the symbol YSHE/lHXRAHSITtTi, loot to the pr*ceding ty-tftol 
to dec lie whether it ie singular or plural. Ry using such contest-sens I tire 
rule? p ¥9 can characterise any language whose sentences caa be listed by a 
de- term! nis tic (possibly neve rending) process. (i*e. they hare the power of a 
luring machine)* There is however a problem la implementing these rules, la 
any but the simplest cases„ the context will riot be as obvious as in the simple 
example given. The choice of replacements will not depend on a single word, but 
may depend in a complex way on the entire structure of the sentence. Soch 
depeniftneies cannot be expressed id our simple rule format t and new types of 
rules must be developed, Transformational grammar Solves this by "breaking the 
generation process down into the context-free base grammar which produces "deep 
structure* and a set of trass formations which then, operate on this structure to 
produce the actual "surface structure" of the grammatical sentence* We will not 
go into the details of transformational grammar, but one basic idea is this 
separation of Che complex aspects of language Into a separate transformational 
phase of the generation, process * 

Systemic grammar introduces context tn a more unified way Into the 
immediate-constituent generation rules. This is done ty intr educing "festures'" 
aseociated with constituents at every level of the parsing tree. 

A rule of t&e grammar may depend* for example, on whether a particular clause 
is transitive or intraasitive. En the examplas "Fr*d found a frog/^A frog was 
found by fred."\ and "«hat did. frad find?*", all are transitive, but the outward 
forms are quite different T A c onto* t-s an sit its rule which checked for this 
feature diTectly in the string being generated would have to be <iuite complex* 
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Instead* we can allow a-ach symtol to have additional subscript 6*, or features 
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which control its expansion* In a way, this Is Hire the separation of the 
symtol HP into AP/FL and HP/SG Id Ottr augemeuted context-free grammar. But It 
ia not necessary to develop whole new sets of symbols with a set of expansions 
for each. A symbol such sis CLAUSE nay be associated with a whole set of 
features (SLICh as TflAJtSlTITB, IHTESJlDGATIYfi, 5UBJUKCTITE, OEJEGT-QUESTIDK, etc.) 
hit there ia a a ingle set of rules for expanding CLAUSE. These rules nay at 
various points depend oa the set of features present. 

The power of systeaic grammar rests on the obseiTB.tion that the 
Context-dependency of natural language is centered around clearly defined and 
highly structured sets of fa-attires, so through their use a great deal of 
coiplexity can be handled very economically. Wore important for our purposes, 
there is a high correlation between these features and the semantic 
interpretation of the constituents which exhibit them* They are not directly 
semantic, but are a tremendous aid to interpretation, A parsing of a sentence 
in a systemic grammar sight look tery much life* a context-free parsing tree, 
except that to each node would be attached a number of features-. 

These features are not randoa. conbiaatioaa of facts about the constituent, 
but are a part of a carefully vorlred out analysis of a language in terns of its 
"ays tenia". The features are organised in a network, with clearly organ! z si 
dependencies. Jbr sample, the features IMt£ELATni) (seamand) and ItfTEflsOGATIVB 
(question) are mutually exclusUe in a clause, as are the features POLAR (yes-no 
question like "Did he go?") and HE-QUESTiaH (Like *Ybo went*). In addition, the 
second choice can fce aade only tf the choice IHTERaOGATIifE was made in the first 
set. A set of mutually exclusive features Is called a "'system™, and the set of 
other features which must he present for the choice to he possible is caned the 
"entry condition" for that system. This Is discussed in detail in references 4 
and 5» 
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Another basic concept of systemic grammar is that of the rant of a 
constituent. Rather than having a plethora of different non-terainal symbols . 
each expanding a constlttieut In a sUghtly different way, tier ft are only a few 
basic "units'" h each haTlng the possibility of a nuaber of different features f 
chosen frofl the %ystem network" for Ibat unit* In an analysis of English, 
three t&aic units see* to explain the structure: the CLAUSE, the G-HOtJF, and the 
WOECi, In geaeral, clauses are made up of groups, and groups made Up Of worts* 
Eoverer, through 1 'raakshift", clauses or groups can serve as constituents of 
cither clauses or groups. Thus, In the sentence "Sarah saw the student saving 
logs/* "til* student sawing loss" Is a HPTTN GflOUP with the CLAUSE "sawing logs'" 
as a constituent (a nodiftar of "student'*). 

The -constituents "who", "three days-", "some of the men oa the board of 
directors," and "anyone who doesn't understand me" are all noun groups, 
exhibiting different features* This means that a PrOS-HAHHah grammar will hare 
only a few programs, one to deal with each of the basic units. My current 
grammar of English has programs for the Units CLAUSE, 10115 GROUP, VERB GEQOP, 
FEEFQSITIOKAL &RO0F, and ADJECTIVE GROUP. 
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1 1 .5 Grammars as Programs 

Let us aae hav a ftrammar as outlined abore could be written as a prQgr.Hu 
Grammar 1 could lie diagrammed: 



DETIKG program SENTIHCR 

fall? 

sucded? 



PARSE a NP^- 

rasw 

PARSE a TP— j fail? 

any voriSi 

Left? *~ 

t 

HEFJftK success 



->aETBftJI fa. Hurt 



DEFINE program HP 



PARSE a DETERtflHEfi ■+■ 

PARSE a NOUH-»- 

X 
REfURH success 



-+RETURH failure 



■' 



jJEFIHE proem TP 



PARSE a TEUB-t 

is It t% 

1$ U IKTRAHSITIVE?-* 



■+KETURK failure 



ASSITI7E7* SPARES a SP-' 

* 



RfiTUJJH success- 



The basic function used Is PARSE, a function which tries to add a 
constituent of the specified type to the parsing tree. If the type has been 
defined as a PSDGJtAMMA^ program t PARSE aetlvat*? th* program for that uqit, 
giving It as iauut the part of the sentence ret to be parsed, if no definition 
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- 

uisti, E*4flSE Interprets its arguments A3 a. list of features which wist be found 
In the dictionary deinitlon of the n«u *ord in the e enters. If so, it 
attaches a node for that word, awi removes. It from the reroaioder of the 
sentence. If not. It fails. If a FROGRAHHMt program lias bean called aad 
succeeds, the ne* node 16 attached to the parsing tree. If it fails, the tree 
U left unchanged. 



; ■ * 
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II .6 The Form of PRG&RAHNAfl GrMaars 

Mrltten in FROCrRAHHAH, the pro-grama would look like; 



8.1 (FMFME SMTBK3E 

2,Z mn&£ HP) »L FAIL) 

2*3 ((PAR&I TP) FAIL FAIL RETURN))) 

2*4 (PDEFINE HF 

Z .5 U tPAHSit D-ETKHW I HER > HI L Fal L) 

2.6 ((Pi&SE CM) fiETURfl FAIL))) 

2.7 (PDEFISE TF 

2 .a (UFAHSJ£ TEaE) NIL FAIL) 

Z r 9 ( < ISq. H TRAMS1TITE) ML INTRANE ) 

2.10 U PARSE HP) RETtfSH NIL) 

2.11 lNfRAKS 

2*13 CU3-Q H IHTaAHSrTITBj R&TUM FAIL))) 



Rwl?g 1*6 to 1,9 would have the forau 

3.13 ([JfimwP &UAFF2 (BOOK) WORD) 

2.14 (DEFPRQP EHR&A.M (7ER3 MTKMU3ITI¥E} TO SO) 



etc* 



This example illustrates some of the basic features of FRO&RAHMAR. First 
It Is embedded in LISP, and much of its syntax La LISP syntax* Unite, such &s 
SENTENCE are defined ae PROCRAHHAR programs of no arguments. Each tries to 
parse the string of words left to he parsed in the sentence* The exact form of 
this. Input string is described in section 1II.6, The Talue of (PASSE SENTEHCEJ 
will be a list Structure corresponding to the parsing tree for the complete 
sentence . 

Each tine a call la made to the function PARSE, the systei* begins to build 
a new node on the tree. Since PaOGSAtfKAjt programs can call each other 
recursively, it is necessary to fceep a pishdOMti list of nodes which are not jret 
completed (L,e. the entire rightmost branch of the tree). These are all called 
"active* nodes, and the one formed by the most recent call to PARSE is called 
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the "currently act We node*". 

We can e saiine oar sample program to 3** the basic operation of the 
language, Whenever a FROGRAJUUR program is called directly by the user, a node 
of tbe tree structure is fiat up. and a set af special variables are oojad (see 
section III*?)* The lines of tbe program are then, executed In sequence* as In a 
LISP FROG, except when they have ins special form of a BRAKCH statement, a list 
whose first mender (the CONDITION) ie non-atomic, and which has either Z or 3 
ether aeabers, called DIRECTIONS, Line 2,3 is a three-direction branch, and all 
the other executable lines of the program are ttfo-direction branches. 

Whan a branch statement Is encOOrt tared, the condition is evaluated, and 
branching depends an Its value. In a two-direc:ion branch* the first direction 
is tafcen if it evaluates to non-nil* the second direction If It is nil* In a 

I three-direction branch, the first direction is taken only if the condition ts 
non-nil, and there is more of the sentence to he parsed* If no mors of the 
sentence reaaine, the third direction is taKen. 

The directions can he of three types. First, there are three reserved 
words r 11 L* RETUPJi t and FAIL* A direct lost of JUL sends evaluation to the next 
statement is the program. FAIL causes the program to return HlL after restoring 
the seaiencs and the parsing tree to tbelr state before that prograa was called. 
EErJEH causes the program to 'attach the currently active node to the completed 
parsing tree and return the subtree below that nods as its value. 

If the direction Is any other atom, it acts as a GO statement* transferring 
evaluation to the statement immediately following tne occurence of that atom as 
a tag. For example, if a failure occur s in Hoe £,9* evaluation continues with 
line 2*12r. If the direction is non-atomic, the result ia the same as a FilL, 

- J hut the direction is put on a special failure message list, so the calling 
progr&Jt can see the reason for failure* vL^ 
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Looking at the progftuia, vt see that 5EHTESCE will succeed only if it first 
finds a HP, then finds a TP which use* up the rest of the sentence. In the 
program VP, we see that the first branch statement checks to see whether the 
n$xt word is a T*r"fc» if so, it removes it froa the remaining sentence, and goes 
on, If mot, VP fails. The sscood statement usee the FROGEAMMAR functioa I5Q* 
one of the functions used for cheeking features. (35Q A B) checka to see 
whether the node or word pointed to by A has the feature B* Hi one of a 
number of special variables used to hold information associated with a node of 
the parsing tree* [see section III*?} It points to the last word or 
constituent parsed hy that program. Thus the condition U SO. 5 TRANSIT ITS) 
succeeds only If the Tero Just found hy PARSE has the feature tRAKSiTlVE. if 
so, the direction Sit sends It tin to the nejit statement to look for a HP% and If 
it finds oae it returns success. If either no such SP is found or the verb is 
not mUSI-rlTfi, control goes to the tag IKTRAHS, and if the T*rb la 
IHEHASSITini, the program VP succeeds* Hate that a verb can have both the 
features IJLTRiKSI TI ITK and TftAflSITIVE, and the parsing will then depend on 
whether or not an abject HP Is found. 



z 
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H,7 Ibe Context-Sensitive Aspect a 

So far, ve have done little to go beyond, a. contest-free- gramiar. How, for 
eiasple, can we handle agreeaent? One way to do this would be for the VP 
proeran to- look back in the sentence for the subject, and check Its .agreement 
with the verb before going on* Ve need a way to clia'u around on the parsing 
tree, looking at its structure ,. Id PfiOGMMHAEt, this is done with the pointer 
FT and the an vine function *, 

Whenever the function * is nailed. Its arguments form a list of 
Instructions for moving FT fruit its present position* Tee instruction Hat 
contains non-atonic C0HDITIQ1S and atonic INSTRUCTIONS* The instructions are 
taken In order, and when a condition is encountered, the preceding instr-jctisn 
is evaluated repeatedly until the condition is satisfied. If the condition is 
of the form (iTDM), it is satisfied only If. the node pointed to by FT has the 
feature A.TQM. Any other condition is evaluated by LISP, and 4s satisfied if it 
returns a non-nil value* Section tll.B lists toe Instructions for *, 

Tor example, evaluating (* C D) yill set the pointer to the parent of the 
currently active node* (The mnemonics are: Current „ Tip) The call (*C DLC PV 
(NF)) will start at the current node, move down to the rightmost completed node 
U»e. not currently active) then move left until it finds a node with the 
feature HP. ( Down-Las t-CompLe ted. Previous), *f * succeeds, tt returns the new 
value of FT and leaves PT set to that value. If it faiig at any point In the 
list, because the existing: tree structure makes a command impossible, or because 
a condition cannot he sSLtisfied, FT IS left at its original, position, and * 
returns nil, 

Ye can now add another branch statement to the VP proaram lo section 11,6 
"between lines 2.S and 2*9 as follows* 

£.8,1 ItOBUSKISat* C ?¥ DLC)3HISl]Li&Xl53 H SU&DLMl)) 
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z.e.2 [jumnsq ft plural) ti&Q h plural))) 

2,S*3 ML [AURBEIBNJ)) 

THals la an et&nple of a branch, statement with an error nee sage. It nofes 
the pointer from the currently active node (the FP} to the previous node (the 
HP) and down to Its last contltuent (the noun)* It then checks to see whether 
this shares the feature SINGULAR with the last constitueeit isarsed oy FT [the 
vert})» If bo t It checks to s-ee whether they share the feature PLURAL. Hot ice 
that once FT has hssn set oy * f U regains at that position* If agreement la 
found* evaluation continues as "before with line 2.9, If not, the program FP 
fails with the message ( AGREE* EHT>« 

So far we hare not made such use of features, except on words- \s the 
grauuiar ABtE more complex, they become ouch more Impartaat* is a simple 
example, we say wish to augnent our grammar to accept the noun groups 
"these fish,* 
"this fish," 
"the Giraffes," 
an* "the giraffe/ 

Rut not "these giraffe," or "tnig siraffes," ¥e ca B no longer check a single 
word for agreement, since "fish" «i»es no clue to number in the first tw, while 
"the" ffiFBs bo clue in the third and fourth * Hum bar is a feature 1 of the entire 
noun Group, and we must interpret it In some cases from the form of the noun, 
aad in others from t&e fora of the determiner, 

We can rewrite oar programs to handle this Goipleiitr as shown in Gramnar 
3i 



3*1 {FDEFiaS S£HTEa£E 
} 3*2 (((PARSE MPJHIL FAIL) 

3.3 tCPASS* FP) FAIL PAIL RETORN))) 
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) 

3.4 (PDEFIHE HP 

3.5 U(AffD( PARSE DBTESWlSBR)trSl DETERMIKED))HIL aiL FAIL) 

3.6 {(PARSE SDU*t)NLL FAIL) 
3.*? ({C(l WTBHMItiED)DET RIL) 

3, fl £ (TRUST H (QOOTE(SlMLAR PLURAL)) j RETORT FAIL) 
3 ¥ 9 DET 

3.10 ((TRUST £ {MEET (TEC* H FV (DlTlRMrSIR) )) 

3.11 (QOOMCSIM&UUR FLUKALJJJ) 

3.12 RETURR 

3.13 FAIL))) 

3.14 {FBEFIKE f? 

3.16 [U PARSE TERBJHIL TAIL) 

3.16 tfHEETtFE H)(F£{*C P* (NP))) (QUOTE (SIK&ULAB PLURAL))) 

3. IS (AMEEHIMTH 

3.19 ((ISQ S TRASSITITSJHIL IKTRANS) 

3 .20 { { PAUSE «P } RETUJtf fl XL ) 

3.21 (USQ H INTPAflSITIVEJRETUftlj FAIL))) 

tfe ha¥* used the PRQGRAHHAfl fu.net inn* FQ. And TRUST, which attach feature 
to constituent g. The effect of evaluating ( FQ. a) la to add the feature A to the 
I List at features fop the currently active node of the parsing tree. TRMST is 
used to- trams far features fron another node to the currently active noda, It$ 
first argument Is a pointer to the none froa which information is to be 
transferred, Tli* second it a list Of features to be looked for. Tor example, 
line 3.8 looks for the features SIHGULAR and PLURAL in the Last constituent 
parsed {the HGUH)„ and adds whichever ones it finds to the currently active 
oode. The "Branch statement beginning with line 3,10 Is more complex. The 
function * finds the DlTERHlHER of the i£F being parsed . The function TE finds 
the list of features of this node, and the function MEET intersects this vith 
the list of features (SINGULAR PLURAL). This intersection is then the set of 
allowable features to be transferred to the HP node fros the HDQ1L Therefore if 
there is no agreement beveen the HQtJK and the DETEaMMEH. TBhST fall* to find 
any features to transfer, and the resulting failure causes the rejection of such 
/ phrases as "these giraffe,"" 

In line 3*7 we use the function CQ which checks for features on the current 

& 



; 



; 
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node* (CQ DETERMINED) wilL be non-nil only if the current node bas the feature 
DETERMINED* (l»e, it we.e put there in line S,&) Therefore, a noun group with a 
determiner is marked with, the feature DETERMINED 4 and is also given features 
corresponding to the intersection of the number features associated witb. the 
determiner if there is one f and the noun, Notice that this grammar can accept 
noun groups without deter»in*re p as in "Giraffes eat apples/ tine* line 3*5 
faiU only if a DETERMINE! is found and there are no sore words in the sentence* 

In conjunction with the change to the KP wogram, the TF progra* *ist he 
nidified to check with th* NP for agreement. 
The branch statement beginning on Line 3,15 does tbis by making sure there is 
a nnmber feature common to both the subject and the verb* 

This brief description explains some of the basic features of PRQ&EAKKAR, 
In a simple grammar, their importance is not odious h and indeed there seem to 
be easier ways bo achieve the- same effect, is grammars become more camples, 
the special aspects of PflOGflAMHAR become more and acre Important , and 1 plan in 
another paper to describe the PRQ&EiKKAR graaaar for Engish which is used hy 
the uaderstander system. 

A number of the other features and details of PROSBAHMAft are leacribei in 
Section III. 



C 
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I I. a Ambiguity and Understanding 

Rftadera familiar with parsing systems may Isy now hare wondered about the 
problea of ambiguity. As erplainad, a PKD&RAKHAfl program tries to find a 
possible parsing for ft sentence, and as soon ae it sacceeda* tt returns Its 
answer* This is not ft defect of the system T tut an active part of the concept 
of language far which tt wag designed. The language process Ls not segmented 
lata th* operation of a parser, followed by the operation of ft semantic 
interpret*]*. tfather, the process is rifled, with the results of aemantic 
interpretation being used to guide the parsing. This U very difficult in other 
forms of grammar, with their restrict*! types of context-dependence, lut it is 
9 traight forward to implement la PROGRAM AA. For erample > the last state sent ^ 
a program for UP m&y be a call to a noiio-phrase semantic Interpreter. If it is 
impossible to interpret the phrase as tt is found, the parsing is immediately 
redirected. 

The way of treating ambiguity is not through listing all 1,243 possible 
interpretations of a sentence, bat in being lata 11 leant in looking for the first 
one, and- being e?en more intelligent in luoking fop ths neit one if that fails. 
There la no automatic backup mechanism in PAOCftAHHAR, because blind automatic 
backup la tremendously lnefficent. A good PROC&AMMAR program will check itself 
when a failure occurs, and based On the structures it has seen and the reasons 
for the failure, it will decide specifically wtiftt should be tried nest. This is 
the reason for internal failUire-messsagfls, and there are facilities for 
performing the specific backup steps necessary. (See section II I. 4) 

As a concrete example, we migit haTe the sentence "l rode down the street 
Lu a car." Ki a certain point in the parsing, the W prograa may come up wttb 
the constituent "the street in a car". Before going fln, the semantic analyser 
will reject the pbrftse "in a car" as a possible aodifler of "street", and the 
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program will attach it instead as a modifier of the action represented by the 

sentence* Since the semantic eye tea U a part of a complete deductive 

undarstaadar, with a definite world-model, the tertian tic evaluation which guides 

parsing can Include both general knowledge (care don't contain streets) and 

specific knowledge (Melvin owns a red car, for example). Humans take ad Tan tag* 

Of this sort of knowledge in their underetandine of Language, and It has teen 

pointed out by a number of linguists aed. computer scientists that good computer 

hand! ins of language will not be possible unless computers can do so as vail, 

fairy few sentences sees ambiguous to humans uhep they first hear then. 

They are guided by an understanding of What is aaid to pick a single parsing and 

a very lev different leaning*. By using this same knowledge to guide Its 

parsing, a computer understanding system could lake advantage of the save 

techvlQus to parse meaningful sentences quickly and efficiently. ¥e must be 

careful to distinguish between grammatical and semantic ambiguity. Although we 

want to choose a single parsing without considering the alternatives 

simultaneously, we want to handle semantic ambiguity very differently* There 

may be several interpretations of a sentence which are all more or less 

meaningful, and the choice between them will depend On a complex evaluation of 

our knowledge of the world, of the knowledge the person speaking has of the 

world, and of what has been said recently- This is particularly true In cases 

of ambiguous uronoun reference* For example, if the systan rare asked the 

sequence of Questions? "is a green block on a table?" "What color is it?" wa 

would expect "it" to refer to the table. If asked "is a block on a green table? 

"What color la It? 4 *, we know that "it** muat refer to the block* IT the second 

question were "¥hat slse is It? 4 * it would be much more amUgnous. To resolve 

1 this, we mist know that green is a color, and that a person is not likely to ask 

the color of aa object if he has Just specified it. This is the type of n 



) 



) 



J 



FH0G-RAXHAK 11.8 page £6 

aabigulty dealt with *br the eyste* through its heuristic programs aad deduct! ft 
system* It however is not directly a part of the grataar. 

TbLe neane that we must discuss only those things the computer knows about 
a&d understands fully ennugh to manipulate thft knowledge necessary for 
Interpreting a sentence. The foras of relationships It aust he able to handle 
go "beyond sWple structures t such as associative networks of links between words 
or arbitrary relational stat™aats U the predicate calculus + Just how much Is 
necessary Is a deep problem, and I plan to Idlscuss it aore in reference to Other 
parts of the aystes. 



i 
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11*9 Summary 

Id understanding the reason for developing PaOCWUMAK, several factors are 
important, The first is that only through the flexibility of expressing a 
grammar as a prograa can we introduce the type of intelligence necessary for 
complete language understanding* FRE&RAMHAR is able to tafca Into account the 
fact that language la structured In order to C0n*ey meaning, and that our 
parsing of sentences dspends intimately an our uoderstandins that meaning* 
FHQirtUrtHUl no take advantage of this to deal more efficiently with natural 
language than a general rule-based syatem,. whether context- free or 
..transformational, Here important, the analysis returned by PBOSEAWMAR is 
designed to serve as a part of a total understanding process* and to lend itself 
directly to semantic interpretation. This was one reason for selecting systemic 
grammar* and has guided much of the design of the system. The exact way in 
which semantic Interpretation can he done, and the reasons why a systemic 
analysis Is important will be discussed in later papers on the semantic aspects 
of the system* 

A reasonably comprehensive grammar of English has been written la 
PROG,HAHHAR* and it is able to Efirse ouite complex sentences* It is being used 
as a part of the system* which is currently being debugged* 

'Some eiaoples of English sentences parsed by P30GRJLHMAR are included In 
Section II* 
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Ill Detail* of the raftSJMUI Language 



III,l Operation of the System 

Since tie granar U itself a program , there U not ouch overhead ma chant 60 
needed for the basic operation of the parser. Instead, the system consists 
mostly of special functions to be used 'by the granmr* The system maintains a 
number of global variables, and keeps track of the parsing tree as it Is built 
"by the malw function, PARSE. When the function PASSE is called for a UHtT which 
has been defined as a PROGRAMMES: program, the system collects information about 
the currently active node, and saves it on a pushdown list. It then sets up the 
necessary variables tc establish a new active node, and passes control to the 
PBOCrRAMJUH program for the appropriate unit. If this prcgrftm Succeeds, the 
system attaches tbe new node to the tree, ani returns control to the node on the 
top of the POL. If it falls, it restores the tree to its state before the 
program was called, then returns control. A PRQGRAKHiR program is actually 
converted by a sinple compiler to a LISP program and run in that fori. The 
variables and functions available for writing PKGGRAKHAR programs are deserihed 
In the rest of part III, Sections III .1 to Itl*5 explain special features of 
the language, Sections 111*6 to 111,9 are sore in tbe style of a manual which 
vo-Jld a-liow the reader to under s tana PROGRAMMAft programs* 

When the function PARSI is called with, a first argument which has not bean 
defined as a PRQ&RAMMftii program, it checks to see whether the next vord has all 
of the features listed in the arguments, If so, it forms a new node pointing to 
that word, wLttt a list of feature* which is the Intersection of the list of 
features- for that word vtth the allowable features for the word class indicated 
by the first argument of tbe call. For example, the word "blocks'* will hare the 
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possibility of "be ins either & plural aoun or a thiri-psrson-s insular 
present-tense TSfb. Therefore, be J ore any parsing it wilt have the features 

{mUH YESB K-PL VB-3PS TRM&ITLTE PHBSEflTh If the eipression tFARSfi VERB 
TRiSSITIfE) Is evaluated when "blocks" Is the nest wort in the sentence to be 
parsed, the feature list of the resulting node will be the intersection of this 
combined Hat with the lUt of allowable features for the wori-cla« TEfrB, If 
we haTe defined? 

(DEFPBOP TSB3 HERB imxHSlTIYE TRAKSITITE PRESENT PiST T^-3PS TB-FL) 

ELIM). 

the tew feature list will be (FERE TRMSITIYE PRESENT VB-3PSK (SLIM is 
simply a property indicator chosen to indicate this lltt vhteh ELIKlnatea 
features), Thus, even though aords may have more than one part of speech, *hen 
they appear In the parsing tree* they will ethibtt only those features relevant 
to their actual use in the sentence* 



^ 
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111,2 Special Words 

Some words must be handled la a very special way la the grammar. The aost 
prevalent are conjunctions, such as "and" and "but™. When one of these is 
encountered, a program should be called to iectde what steps should he taken la 
the parsing'. Tats is dtrne by giving these words the grammatical features SPEC 
or SPECL* Whenever the function PAESE Is evaluated, before return lag it Checfcs 
the next word id the sentence to see if It has the feature SPEC* If bo, the 
SPEC property on the property list of that word indicates a function to be 
evaluated before pursing continues. This, program can In Urn call PflflGaAMXAR 
programs and matte an arbitrary number of changes to tae parsing: tree before 
returning control to the normal parslag procedure. SPECL has the same effect, 
but Is checked for when the function PARSE is called, rather than before It 
returns* Yarlous other special variables aad functions allow these peagraas ta 
control the course of the pare ins process after they have been evaluated. By 
using these special words* it Is possible to write ama singly Simple and 
efficient programs for some of the aspects of granoar which cause the greatest 
difficulty. This is possible because the general fori of the grammar is a 
program.* 

for esaaple, "and" can be defined as a program which is diagrammed: 
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Parse a unit of tha same type 

a* the currently active node "*" — ' "* Return failure 

I 

Replace the node with a new node 
c Dttbi nt ng the old one and the pfta 
you have Juat found 

. I 

Aatu.rn success 

For a sample, given the sentence "The giraffe ate the apples and peaches/' 
the program would, first encounter "and" after parsing the ?»UH apples. It would 
than try to parse a second NCMfll, and would succeed^ resulting in tht structure : 
S£HTEHCE 




r NF / / PBS 

\ 7 / / 

DETERMINES HOOK TKfiE DEPEiiWlHER TOUX 



HGUN 
the giraffe ata the apples and peaches. 



If we had the sentence, "The giraffe ate the peaches and drank the Tonka." 

the parner would first try the same thine. However t "drank" H not a JIQUH, ao 

the AMO prosraa wouli fall apd the 1TOUK "apples* wouli be returned unchanged* 

Thi3 would cause the HP "the apple e" to succeed, bo the are program would T» 

called again. It would fall to find a .TO Beginning with "drank**, so tha RP 

"the apples" would be returned, causing the ?P to- succeed* This tine, AHD 

would try to parse a TP and would find "drank the vodka" w It would therefore 

■ake up a encshlnad tp and cause the entire SSNTSHCE to he completed with the 

£■■ 



3 true tut* j 
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SKHTENCi] 



/ X 

I I 




I 



the giraffe a,te 



l 1 

the peacrie 



peach* s and d ranis the 



VEftB DETEIIHIKBR TOLTH 
I I I 



vu:.l-.!i 



The program to actually do tils would t&fcfl only 3 or 4 Lines In a 
PBOGflAHNAit grammar. Ed th* actual system, it is *>re coupler as it hanlles 
lists (like *X B* and C**) other ton juncx it? rig (such as "but") and special 
constructions (.suca as "troth ft and B"l, 
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111*3 The Dictionary 

Since PRQ&HMMAa ll embedded in II $F, the facilities of LISP for handling 
atom names are used directly. To define a word, a list of grammatical features 
Is pat on Its prop-arty list under the indicator 'liOHD, and a semantic definition 
under the indicator SHflTG, Two facilities art Includad to arald having to 
repeat information for different forms of the sane word, Tlrst, there it as 
alternate way of defining words, by using the property indicator WORM* This 
indicates that the word giren Is an inflected form, and its properties are a 
modified form of the properties of its root, i MOhtU definition hat three 
elements, the root tfOrd, the list of features to be added, and the list of 
features to he removed* For example, ve might define the word "go" by: fDEFPRQP 
&D (VERB I STRAWS ITI YE MOTION IKFIKITIYE) VORD} We could then define '"went'" as 
' (DEEPROP KJEHE (GO <PA5T)(IKFISIT1FE) } iORDl) this Indicates that the feature 
IflFItfrmE is to 'be replaced by the feature PAST, tait the test (including the 
semantic definition) is to remain the same as for "go*. 

The other facility is an automatic system which checks for simple 

modification, smcji as plurals, *-ln£ r ** forma, "-sr" and "-est" forms and so 

forth* If the word as typed in is nat defined, the program Loots at the way It 

is spelled., tries to remove its ending (taking into account rules such as 

changing "running"' to "run" 1 , but "buzzing" to "buzz") * It then tries to find a 

definition for tha reduced root word, and If it succeeds. It makes the 

appropriate changes for the ending (such as changing the feature SlftrULaR to 

PLURAL) » The program which does this is the one part of the PRMftAMHiFt system 

described here which is specifically built for English* Everything else 

descriued is designed generally for the pare ins of any language. In any l.-- 
J 

particular language, this input funtion would have to he written according to 

the special rules of morpaegraphenic structure. The only requirement for such, a 
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program Is that Its output oust be a list, Each aeaber of wnich corresponds to a 

word In the original sentence, and Is in the farm described la section 111*5*, 

This List is bound to the variable "SUKT, and Ls Che way in which PHOGfiANMAH sees 

its input. 
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til .4 Eackup Facilities 

As explained U section II»S, there U no automatic backup, but there an a 
number of special functions which can be used la writing graamftrs* The 
sinplest* (PQFTO K] siaply removes nodes from the tree* The argument la a list 
of features, and the effect is to remove dftueiiterE of the currently active node, 
beginning with the rightmost and marking lefty ord until one la reached with all 
of those features* (?QP X] Is the same, except that it also removes the node 
with the indicated features. If no such node exists, neither function takes any 
action* (FOP) is the same a9 (FOF NIL), and a non-nil value is returned by Both 
functions If any action has been taken* 

A very Important feature is the CUT variable. Cms way to do backup It to 
first try to find the longest possible constituent at any point* then if for any 
reason an Impasse Is reached h to return and try again , limiting the confiltuent 
froa going as far along in the sentence* For example, In the sentence *Was the 
typewrU&r sitting on the cake?", the parser will first find the auxiliary verb 
"was"* then try to parse the subject. It will find the noun group "the 
typewriter sitting on the cake*"* which in another context might well be the 
eabject ("the typewriter sitting on the take 1* broken/). It then tries to 
find the verb, and discovers none of the sentence is left* To back up* it suet 
change the subject. A Yery clever program would look at the structure of the 
noun group and would realise that the modifying clause "sitting on ths cake" 
nust be dropped* A mere simple-minded but still effective approach would use 
the following instructions: 

(** M P¥) 

(fOF3 y 

j {(CUT Pm 3 SUBJECT (XEftOa)) 

The first command sets the pointer PT'aI to the last word In the constituent 
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(la this case., "cake")* The next Feasores that constituent* The third seta a 

special pointer, CUT to that location, then sends the program tack to the point 
where it was looking for a sift-Jest. H would now try to find a subject again, 
"but would mot he allowed to so as far as the word "cake". It night now find 

the typerwriter sitting,** an analog to '"The nan sitting is *jr uncle** If there 
were a good semantic program, it would realise that the verb M slt* cannot I* 
iiied with an inanimate object without a location specified* This would prevent 
the constituent "the typewriter sitting" from ever Being parsed* Eves If this 
does not happen, the program wSuld fail to find a verb when it loofeed at the 
remaining sentence, "on the cake." By going through the cutting loop again, It 
*yild find the proper subject, "the typewriter/ and would continue through the 
sen te ace. 

Once a COT point has been set for any active node* no descendant of that 
node can extend beyond that point until the CUT la aoTed* Whenever a PRG&WHar 
program is called, the Tar table BilD It set to the current C1TT point of the node 
which called it ( The CUT point for each constituent is initially set to its 
BSD. When the function PAUSE is called for a ward, it first checfts to see if 
the current CUt has been reached, and if so it falls. The third branch in a 
three-direction branch statement is taken if the current CUT point has been 
reached. The CUT pointer is set with the function CUT of one arguaeat,. 
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111,5 Messages 

To write good parsing programs, we say at tines waist: to know why a 
particular PE05EAMHAH program failed,, or why a certain pointer commanl couli not 
he carried out. In order to facilitate this, two message Tariaoles are kept at 
the top level of the system, ME3, and ME5F. Messages can fee put on MES In two 
ways, either tor us-ing the social failure directions In the branch statements 
(see section II. £) or T& using th* functions M and MQ„ which are exactly like F 
and FQ t except they put the Indicated feature onto the menage list HE for that 
unit, When a unit returns sit her failure or success * HES 1% bound to the 
current value of ME., so toe calling program can recal^e an arbitrary list of 
raeas&eM for whatever purpose it aay want then. M£SP always contains the last 
failure message riceived froa ** or *. 



; 



} 

irI-^6 Tne form of tiw P*,rai[i« Bnic 

Each node is actually si list structure with, the following info nation: 

FS the list of faaturas associated with, the node 

SB the place Id the sentenc* where the constituent begins 

I the plate Immediately after the constituent 

H the subtree "below that node {actually a list of its daughters 

in reverse order t so that H points to the last 

constituent parsed) 
SM a space reserved for semantic information 



these can he used in two ways. If evalaated as Tariablea, they will 
always return the designated info mat ion for the currently act ire node* C Is 
always a pointer to that node. If used as functions of one argument, they #1 
the appropriate values for the node point** to by that argument; so (Ml H) 
gives the location in the sentence of the first word of the last cen-stltuant 
parsed, while {rfi(0 H)) aouLd give the feature list of that word* 

Bach word in the sentence is actually a list structure containing the 4 
Items- 

FE as above 

SMW03D the semantic definition of the word [see section IIl.fi] 

WOHD the word itself {a pointer to an atom) 

HOOt the root of the word te.g. "run" if the word is 

"runnlne")* j^ 
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111*7 V&rL&hLae Maintained by the Systei 

There are two type? of ?ar tables, those touftd at the top level, and those 
which are rebound erery ttae a PRQGfllflhlM program Is called, 

Variables bound at the top level 

H Always points to next word in the a ftnt sue fl to he parsed 

SEST Always points to the entire e entente 

PT FT* Tree and sentence po in tars* 

See Section 111*6 
KE5 MES? Li at of massages passed up from lower levels. 

See Section III. 9 

1 Special variables bound at each lewl 

C FE ^B SM a See section I IT. 2 

ffi CUT EKD See section Ill.a, SH always equals [*K>T(EQ CUT SHD) J 

DHIT tli* name of the curr ently active FED&RAHHAR prof ran 

HIST the list of arguments for the call to PARSE 

t These form the Inital feature list for the node, 

hut as other features are added t REST continues 

to hold only the original ones*) 
Tl T2 W Three temporary PRDG lariahles for use 

hy the PEQGRAKHAR program in any way needed* 
JffB Bound oaly when a CLAUSE is parsed 

used as a pointer to the gala verb 
' HE List of aesaages to be passed up to neit IctbI 

See Section II 1. 9 
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III.S Pointers 

The systen alwaya maintains two pointers * FT to a place on the parsing 
tree, and. POT to a place In the sentence* Theae are no Tel 1>y the fundi ona * 
and ** respectiTtljj as explained In aection II /7* The Instructions for FT are; 

C set FT to the currently acti** nod* 

E set PT to the noEt resent (rightiost) daughter of C 

!'JL (down- last) no re FT to the right do st daunts r of its 

current value 
DLC {down-last completed) like Ol, except it only moves to nodes which 

are not on the push-down list of active nodes* 
DF (down-flret} like DI, except the leftiost 

Pf (previous) move FT to its left-adjacent sister 

MX (next} move FT to its right-adjacent aieter 

U (up) move FT to the parent node of its current ralue 

B Hove FT to the next word la the sentence to be parsed 



The pointer FT'rf always points to a place In the sentence. It U moved toy 
tha function ** which has the same syntax as ** and the coraandsi 

H Set FTY to the next word in the sentence to he parsed 

Jtf {first-word) set POT to the first word of the cones t truant 

pointed to df PT 
* L¥ (last-word) like FT* (7; 

AH (after-word) like Fw, tut first word after the constituent 
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IW (nest-word) Set PTV to tiie next word after Us current value 

P¥ (pPSTl0U6-wflt^} lilte HW 

SI¥ t sen tenee-fi rat- word) set PTV to the first word in the s#T3tenc« 

SL¥ tsenteace-last-vord) LiKe SDf 

Since th« pointera are oeund at tha top iaTfl^ & program which calls others 
which more the pointers may wacit to pres&rre their I o cat ton* PTkf is a staple 
variable fc and can he saved with a S1TPQ, but PT operates by keeping tract of the 
way it has heen noved. Id order to be able to retrace its steps. This is 
necessary siaca LIS? lists are Uireiie-d in only one direction (in this case:, 
from th* parent noAi to its daughters, and from a right sister to Us lftft 
slater). The return path is bound to the variable FTR* and the c&offlaoi (PTST I) 
saves the Tallies of both-PT and PTR under the rar labia X, while tPTES I) 
restores botti values. 



.)■ ■ . 6 
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III. 9 Feature Hani filiating 

As eiplalned in section ll*7 t we wist lie able ta attach features to notes 
in th« tree. The functions F, FQ, and THUS? are U3*4 for pat ti els features onto 
the current node, while A and &Q remove tbet, (f A) seta th* feature l£tt ¥£ to 
the union of Its current value vitti the list of features A, (FQ A) adds the 
Biagla feature A (i.e. it quotes it* ar&u»ent), ("FRUSTA B) was explained in 
Section IK7. fi and flQ are inverses -of F a&d TQ. The- functions IS t ISQ f CQ, 
and JKJ are use* to eiaraine features. If A poisifcs to a node of the tree or word 
of the sentence, and B points to a feature* (IS A B) returns non-nil if that 
nodYhas that feature. (ISQ A. 3} is equivalent to (IS A (Q[K>TB B)) p (CQ B) le 
the saae as £I5Q C B) (where C always points to the currently actUs node), aatf 
(KQ B) is tie same as {I&Q ft B)(M always points to tie next word In the sentanc* 
left to be parsed) , 



i 
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IT Examples of Sen tease a Parsed. 

Thia station demonstrates the use of PHOGRAKKAR on two English sentences. 
They were parsed using, the current English graarar for ttie ays tea * In the 
examples., a. number of features art used* It le difficult to explain their 
significance without a thorough explanation of the ays teas from which the 
features tiers selected. This grammar will be fully explained In a forthcoming 
paper* 

The form of input to PflpdHAJtMAS is the sentence In normal orthography an-3 
punatuatioo, The actual console dialogue U re prod need* with the inputs 
underlined* The function tfALLP Is one of a number of functions used to eEamine 
, the paraing tree from the console* It printa out a representation of the tree 
in a readable form. In normal use, after finishing the parsing, PROGRAKHAB 
would continue vitb semantic analysis* For use without semantics* it halts to 
allow the user to examine the results, 

(PROSaAMflAlU 
HKADT/ 

HflW HABT EGS5 JFOiJLO YOU HATE BE£a SOUM Tfl 05S IN TIE CASK IP YOiT HAM'T 
TJHRTiSfl Y3GR HPTKE3 * S HffilPi: WAS ifflOBG? 

LISTESIJE 



fWALLP C* 



y 



\ 
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{{{m* Hl$t EC£S WOULD TOG HAVE BEES GOLtC TO USE IN THE 

CAKE IF IOtf HAJTH'T LEARHED YOUR K0T3BR*S RECIPE WAS WHOSE) 
{CLAUSE MAJOR QUEST HGQUE5 PGLH2 ACTT OaJl} m*S) 

C t (HOW HAST E&GS) CC QUEST HQHXAKT KDET KPL DE7) 

UflOV (QM) 
(KAHY (40ET)) 
(E&SS (a UPt})}} 

(MOULD 1VB ADS MODAL QiUX}) 

( (YOU) (NG SHU DSF S$ NFL) {(TOil (FRQH HP! IS SUU OBJ)}}} 

((HJLfE BEEN flOIilG TO USE) [VG MOOAL RAGR (TUT PAST MdflAL}} 

([WOULD (TB AdX HOOAL MOT)) 
(HATE {HATE TB AUK TO TRASS)) 
(BEES (AUX Tfl BE EH)) 
(COISC (ffl 1TKSS IM&)) 
(10 (TO)) 
{USEF{YB TO TRAttS MVB)))) 

((H TttE CAKE) {PREPS) 

((IN (PLACE PREP PLACE)) 
({THE CAKE K MO OBJ DfiT US DEF) 

((THE (DET IjPL «S DEf}) 
(CAKE [.n HS)})))) 

((IF YOU aADO LEADED YOUH. MOTHERS RECIPE HAS ifiBKS) 
(CLAtfSS BOUStD DECLAR ACTT TRAHS) 

({IF (BIDDER)) 

((TOO") («J StfBJ DEE SS 3FL) ( { TO IT (PRDU IPL *S Stf&J OBJ)))) 

([HADK*T LMRHED) (T$ TFL T3PS tfEG {PAST PAST)) 

({SiOfi'T (EAVE 7E ABI TEAKS PAST VPL T3PS VFS UK)) 
(LEARAED (TB TRAHS REFOB PAST M MVB)))) 

[(TOUR MOTHER'S RECIPE WAS KRDK>} 
[CLAUSE J$M& REPORT OBJ 0BJ1 DfiCLAR BE 1ST) 

([[TOUR MOTHER'S RECIPE) 

(KJ SHBJ HS DEF DET POSES) 

({(TOUR MOTHER'S) 

(KG SQBJ K$ im OET POSES POSS) \ 

) U(TOQfl) (!B SUBJ F0$£) 

((TOUR (PHD 31 HPL KS $U3J OBJ PGSS]))J 
(MUTHER'S (H H& P0$$)))) 
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) 



(BECIPE (K HS)))J 

((HAS) (TG T3PS m (PAST) J 

((MAS (AJI YB BE T3PS VFS PAST WTB)))) 

[{nova) (adjg ^ cohf) (franu (a?)))))))))) 



READf/ 

PICK. 1TF ADTTHIiia GHBE1. AT LEAST TflKEE JT THE 3L0CSS_ A HP EITHZR 
A .BOX .OR A SPHKRbl tfHlCEi IS BlSSSfl Tl-'Jfl Ajilf *KlCJC OM THE TABLE. 

LlSfEMlWC 

(UALLP C) 

(([PICK OP ASTTHISS GREEN /. AT LEAST THRflE 07 THE BLOCKS /. MO SITHBR 
A BOX DE A SPHERE ¥31 CFf IS BIGGKfl TEAK AfflT BRICK Q?i THE TABtE) 
<CLAkISE MAJOR WP£R ACTT TRAMS) 

(((PICK) (TO- IHPIR) ((PICK (YPRT VB fO TRAHS HVB))T) 
(UP (PRT)) 

{(AJmTTHIJE CREES /, AT Lll&T f^tEtSE OF THE BLOCKS /, AHO EITHER 
A TOX OR A SPHERE WHICH IS BIGGER. TJIAi AMI BUCK ON TRE TABLE) 
(HS OBJ OBJ1 EITHER COKFOUKD- LIST IS) 

({(AJffTHUG GftSaU) (*£ OBJ OW1 TPMH) 

{(ANYTHING (NS TFRON) ) 
[GREEN (E?)))) 

CUT LEAST TSREE OF THE BLOCKS) 
(ffi OBJ OBJ1 COMPONENT HUHD SOH HPL .>£T Of) 

((AT (AT)) 
(LEAST (NOMD HUHDATJ) 
(THREE (BDII)) 
({OF TUX BLOCKS) 
(FREPC OF) 

((OF (PREP)) 
((THE BLOCKS) 
{m OBJ OET HPL >TBF) 

((THE (OET HPL B£ DEF)) 
(BLOCKS (H HPL)))))))) 

((A BOX OR A SPHERE MICH 13 BIGGER TEAN AST B5ICK OH THE TABLE) 
(NG CU tf&JL COMPONENT QH C0;4P9IMD BOTH NS) 

(tU KH) 

(N& OBJ OBJl COtlPOSEriT DET MS IffiffiF) 
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((A {DET NS IUDfiD) 
(BOH (U SS)))) 

{{A SPHERE ¥UICa IS BIGGEE THAK ASY ERIC* OS THE TAKE) 
{M} OBJ 0BJ1 COMPOHEKf DEI HS IHDSF) 

(U (DET KS IHDEF)) 
(SFHE&E (H SS11 

( (WttlCH IS BIGGER THAN AMY BRICK OS THE TABLE) 
(CLAUSE R3Q StfBREL BE IHT) 

(((NHICB) {HG BELWD DBF SPL) ( (1HICH (KPL))H 
((1$) (TG V3FS (FEES)) ((IS UUX VB BE T3PS PRES X7B)))) 
(UI&G&R TKAH ART BRICK ON THE TABLE) 
(ADJG 5 COMP COJIPAR THAN) 

({BIGGER (EP CQMFARM 
(THAR Cms)) 
CURT BRICK OH TFIls TABLE) 
(HG SUBJ CCH4FAH PET US ^MTFR) 

UAHY {!)ET *£ RPL QHTFR)) 
(BRICK {H KS)) 
((OR THE TABLE) 
(FREPG QJ 

{{OH (PREP PLACE}) 
{{THE TABLE) 
(HG OBJ OET HS SEP) 

{(THE (DET HPL HS DBF)) (TABLE (H HS))))))) ))) }>>)>))))}) 
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